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To determine the correlation between unit test 
performance and retention on final examinations, scores of 68 
secondary level teaching candidates enrolled in a general methods 
course were studied. Onit tests were administered frequently to 
determine student achievement of tie 38 course objectives. Two 
retests per student were allowed, with retesting focusing only on 
those objectives not achieved. The 83-item final examination was 
categorized with respect to the 10 instructional units in the course. 
Results indicated a correlation of .406 between unit test performance 
(expressed as objectives achieved) and retention scores. Correlation 
coefficients between unit objectives achieved (both total number and 
number achieved on the initial attempt) and the retention test 
subscore for that unit were also positive. In conclusion, empirical 
evidence supported the assignment of grade credit on the basis of 
attainment of objectives during instruction; however, the final 
examination should also contribute to the course grade. Such grading 
policy favors the Personalized System of Instruction. The correlation 
values are not so great as to encourage the Mastery Learning approach 
which suggests that grades can be assigned entirely by final exam 
performance. (CP) 
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The purpose of this investigation was to determine whether accomplish- 
ment of performance objectives determined by satis factory performance 
on unit tests during instruction, is related to the candidate's performance 
on an end-of-course retention test. Investigating this relation provided 
empirical evidence supporting the assignment of grade credit on the 
basis of objective attainment during instruction rather than resorting 
to the final test to determine a student's course grade. This investi- 
gation was conducted with sixty-eight candidates in professional education 
coursework, which immediately preceded student teach inq. 
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The Mastery Learning strategy and the Personalized System of 
2 

Instruction .have provided the rationale for numerous investigations on 
individualized instruction over the past decade. The following paragraphs 
provide brief descriptions of these approaches which presume to meet 
the instructional needs of each student. 

'The Mastery Learning strategy limits mastery of the subject to the 
behavior component of stated performance objectives and provides each 
learner with the necessary time and instruction to achieve those objectives. 
Instructional units are approximately two weeks in length and seqCiential, 
that is, early units provide prerequisite material for later units. The 
instructional mode endorsed by this approach includes large group instruction 
with the instructional activities and time management under the teacher's 
control. Criterion referenced unit tests are administered at the conclusion 
of each unit to measure student proqress*and success in achieving the 
performance objectives. Ordinarily, this test is corrected by students 
but not recorded for a grade, the results are keyed to the objectives and 
used by the student as a guide to review for the final test. For those who 
do not reach mastery, several remediation techniques are recommended. The 

f 

use 0f a variety of remediation materials and activities is felt to meet 

the instructional needs of the students more adequately than those no 

experienced ini tidily in the unit. The course continues through succeeding 

units with assessments and pr^MripUvo ^mediations until oarh student has 

mastered all the objectives in thp course. A final test (summative examination) 

3 

is 'administered at the conclusion of the course for grade assignment purposes. 

In comparison to the mastery plan, a course based on the Personalized 
System of Instruction is typically divided into several units each of which 



centers around a small number of performance objectives to be attained 

in one week.. The instructor prepares study guides which contain questions 

and comnents related to the textbook materials and performance objectives. 

Lectures and demonstrations, if used with this approach serve to motivate 

and create interest rather than provide substantive information. Typically, 

a student reads the unit materials and responds to the study-guide questions. 

He then comes to class, where he completes a written unit test referenced 

to the unit objectives. A proctor scores the examination and provides 

immediate feedback. If the student has answered enough questions to 

reach criterion, usually above 80, M he can proceed to the next unit at 

his own pace. However, if he fails to reach the criterion level stated in 

the objectives, he restudies the original materials and retakes alternate 

forms of the unit test until he does reach criterion. Grades are based on 

the number of units (often expressed in ternib of objectives) mastered with 
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a small weight on final examinations . 

Reviews of the research on these individualized approaches to 

instruction have addressed cognitive outcomes (achievement, retention. 
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transfer) and affective outcomes (interest, attitudes) of learners * ' . 
These reviews conclude Mastery Learning and the Personalized System of 
Instruction approaches enhance cognitive outcomes and cultivate positive 
attitudes. Moreover, thesr reviews have examined special component:, of 
each system, for example, pacing of instruction, use nf pro* tors, use nf 
lectures, criterion levels for master/, testing format, frequer-c/ of 
testinq, grading practices, and interactions between the instructional 
component and student learning style to determine thn respective mfluenm 
of each component on thn no.ttr.r findings mpn? fnd in the liteMfur*'. 



Although these reviews have examined the frequency of testinq 
and the nature of examinations, the relation between unit test performances 
and retention test results has not been addressed. A significant relation 
between these assessment variables would give credence to the practice of 
awarding grade credit on the basis of mastery performances on unit tests. 
Given the emphasis on instructional reniedi ati on by both of these approaches 
to individualized instruction, a case can be made that grade credit 
should be awarded whether the mastery performance occurred on the first 
or successive administrations of the unit test. With this antecedent, 
the research question for this investigation became: Do positive relations 
exist between unit test results, whether from initial or retest adminis- 
trations, and retention test performances (total score, and unit subscores)? 

t Methodology 

Sample 

This investigation was conducted under the sponsorship of an 
educational curriculum and instruction department at a Land Grant University 
accredited by the Southern Association of Colleges and Universities and 
the National Council for Accredition of Teacher Education. 

Sixty-eight secondary level teaching candidates enrolled in a 
general teaching methods course participated in this investigation. 
Academically, each candidate root, the followinq departmental criterion 
for admission into student teach inq to he enrolled in the class: 
a) Overall Oracle Point equal to or exceodiiui ?.?h 
based on a 4 point scale. 
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b) Grade Point Ratio from 18 semester hours of teaching 
field coursework equal to or exceeding 2.25 based on a 
4 point scale. 

c) Senior standing in the University, i.e., completed 95 semester 
hours. 

d) Endorsement by a professor in teaching field attesting to 
the candidate's competence in that field. 

Certainly no claim is made about random selection of candidates, 
since all students who completed the course and retention test were included 
in the sample. This decision was made to maximize the sample realizing 
that reported alpha levels, given this assignment procedure, increase the 
likelihood of type II errors. 
Course Description 

The independent variables under consideration in this investigation 
we^re obtained as part of the instructional process for the general methods 
course, Principles and Practices of Teaching (EDCI 423). This course 
consisted of' ten instructional units which were developed to encourage 
independent study and self-paced learning. Thirty-eight performance ob- 
jectives delineated the expected cognitive skills and the levels of 
performance (usually 80') necessary to signify their acquisition for each 
of the various units. 

The instructor was available during the scheduled course hours 
and during his posted office hours for individual tutorial sessions 
and small group discussions. However, with thn exception of three units, 
class attendance was not required. The units which required attendance 
involved a number of group activities and demonstrations involving 



ERLC 



conmuni cati on skills. 

Unit j/ests and assessments for objectives were administered in 
accordance with the chronological schedule accompanying the course 




syllabus. Students were given immediate feedback on the results of 



examinations and encouraged to review both the material they initially 
experienced and supplementary material if they failed to reach criterion 
on one or more of the unit objectives. A limit of two retests per student 
was possible for each unit, with retesting focusing on only those objectives 
not achieved. Monitoring of an individual's progress was maintained by 
utilizing a computer support system which scored, recorded and provided 
printouts reflecting whether objectives were achieved on the first or 
succeeding trials**. 

Course grades were determined on the basis of the number of objectives 
achieved with no penalty being assessed because an objective was not 
accomplished on the initial attempt. In order to qualify for an "A" 
grade, each student had to submit assignments and attempt all thirty-eight 
objectives, attaining ninety percent (34) of the objectives, the minimum 
number for an "A" grade, would not suffice. A final examination (retention 
test) was administered at the conclusion of the course to determine the 
strengths and weaknesses of the instructional program. Students were 
instructed not to prepare for this examination, since it had no bearing 
% whatsoever on their course grades. 
Ins t r umo n t atj c in 

This final examination contained eighty-five items of threp typos , 
i.e., multiple choice, true-false and classification. Items wore 
categorized with rrsprcf tn the Umi instructional units with throe units 
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(Discipline, Performance Objectives, lost Construction) being ropresontod 
by fifteen items each, four other units (Interaction Analysis, Teacher 
Questions, Grading Practices, Teacher/Law) were each represented by ten 
items and three of the ten units (Unit Planning, Simulations/Games, 
Professional Materials) were not represented on the examination . A KR-20 
estimate of internal consistency for the examination was determined to \ 
be ,840. 

Content validity of the instrument *'is addressed by selecting items 
from unit tests which were referenced to the performance objectives of the 
course. The first draft contained one hundred twenty-five items which 
represented nearly every item contained in the numerous unit tests. Pilot 
testing of this instrument revealed a number of items with little dis- 
criminating ability and others which contained ambiguous stems and answer 
choices. After review and appraisal, forty items were removed resulting 
in the final form containing eighty-five items. 

Unit tests were administered frequently to determine student progress 
and accomplishment of the performance objectives for the course. Those tests 
usually provided five items/objective and required four correct responses 
to signify objective attainment. Three versions of each unit test were 
prepared since that number of testing opportunities were possible. How- 
ever, few instances were recorded where three tests were taken by a student 
with respect to a particular objoctive. Item statistics and estimate of 
internal consistency wore not determined for tho. unit, examinations, 
but content validity was considered by both instructor (before testing) 
and student (during testing) alike since each assessed the relation 
between test items and the stated objective. If students challenged 
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the relation of a particular item to ,»n objective, then efforts were m.ule 
to explain t(ie relation. The outcome of the challenge resulted either 
in the retention or removal of the item depending on the situation. 

findings 

Unit test performances of students expressed in terms of unit 
objectives achieved whether on the first, second, or third attempt were 
obtained from printouts of the computer support system designed for this 
course. Values gleaned from this support system indicate that on the 
average, each candidate achieved 33,8 objectives while remediating five 
objectives. 

Retention test data were obtained from the administration of the 
retention test at the conclusion of the course. The total score and unit 
subscores were expressed both as raw scores and standardized T scores.* 
Standardized scores were selected for analysis in the investigation, 
consequently the means and standard deviations for each set of retention 
scores were identical, 50 and 10, respectively. 

A scatter plot, was generated and the corresponding correlation 
coefficient was determined between the total number of objectives achieved 

by each student and his performance (total score) on the retention 
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test using statistical routines from SAS~ . Figure 1 presents the 
scatter plot which graphically depicts the correlation of .406 (p .0006) 
between unit test performance expressed a< objectives achieved and retention 
scores as structured by this investigation. The scatter plot illustrates, 

Insert F i^u re_J 
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that a hi qh proportion of students achieved thirty- four or more objectives, 
A factor which undoubtedly influenced the distribution of objectives 
ach'eved was the grading system which required the attainment of thirty- 
four objectives for an H A" grade. Other cogent observations from the 
plot are: the greatest range of retention scores (30.7 to 69,3) occurred 
when thirty-four objectives were achieved; and higher retention scores 
occurred as more objectives were achieved. 

Additional analyses were conducted to determine if the relation 
observed between the cumulative values of objectives achieved and the 
retention test would be observed when individual instructional units 
were examined. Units were selected for additional analyses if they 
were developed around five or more performance objectives. Four of the 
units met this criterion (Dis-cipl ine, Performance Objectives, Test 
Construction, Grading Practices) and) were subsequently analyzed. Correlation 

coefficients were determined between! the unit objectives achieved, both 

i 

the total number and the number achieved on the initial attempt, and 
the retention test subscore for that unit. The results of the analyses 
are presented in Table 1, 

Insert Table 1 

Clearly, the relation determined from the overall calculation is 
reflected in three of the four units. One possible explanation for (he 
smaller, coefficients for Lho performance objectives unit i^ that nearly 
all of the test i t^ms related to this unit required the student to 
classify behavioral phrases of objectives into the various categories 
of the coqnitive and affective domains. The instructional activities 
developed to impart these sHlls worn inadequate and subsequently were 

° lit 
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removed as were the performance objectives they related to. Unfortunately, 
the objectives and activities were included in the instructional program 
for this investigation, however. 

Examining the correlations more caiefully, it is noted the 
correlation values for the "total objectives achieved" and 
the coefficients for the "objectives achieved on the first attempt" are 
nearly equivalent. Apparently the retention of cognitive skills is not 
too different for those students who achieved the objectives on the 
first trial compared to those who remediated arid retested. 

Discussion 

These findings permit an affirmative response to the research 
question under consideration in' this investigation. Clearly, a positive, 

relation was found to exist between unit test performance and retention , 

I 

scores. Moreover, the bivariant distribution depicts greater variation 
among retention test performances as the number of objectives achieved 
(unit test performances) increase. This variation of scores might 
suggest that individuals who required more than one attempt to reach 
criterion on unit objectives would not perform as well on the retention 
test as those who achieved the objectives on an initial attempt. If 
this explanation is viable, then higher correlation values should occur 
between unit retention scores and objectives achieved on the first 
attempt then when t d t til objectives achieved is one of the variables. 
This phenomenon did not occur consistently, thus the explanation is not 
acceptable. Apparently students given a "second chance" on a unit test 
tended to perform as well on the retention test as those who achieved 
the objectives without remediation. 
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The primary goal for urvlet tak i ng this uive^n .Mtinn wa, to detunm ne 
if empi rical. support is possible for assigning grade credit vi unit 
test performances, given an individualized instructional approach which 
includes remediation and retesting of unit objectives not achieved 
on an initial test. Since positive correlations were found between 
objectives achieved and retention test performances for both cumulative 
values and unit values, empirical evidence does exist to support this 
goal. Certainly the correlation values are not so great as to encourage 
adoption of a grading policy based solely on objective attainment (unit 
test performance). However, these results do support the notion of assigning 
grade credit for objective attainment with the final test of the course 
contributing to thp course grade. This recommendation is consonant with 
the grading system of the Personalized System of Instruction^. Under 
this system, student reinforcement is provided through hiowledge-of-resul ts 
and grade credit being awarded for successful performances on the unit 
examinations. Conversely, the Mastery Learning approach suggests that 
grade assignment be made entirely on the basis of final test performance^. 
Reinforcement under this system appears to be predicated pntirely on 
knowledge-of- performance. 

Pragmatically, student motivation Appears to bo favored by the 
grading approach endorsed by the Personalized System of Instruction. 
Moreover, this investigation has provided ompinml «*vid*Mirn whwh ar.- 
consistent with this grading policy, (iiver. these nlr^nrv-it i on-; , individ- 
ualized systems of insttuction which include remediation and }vte x ti!wi 
in their i ns tructlw^a^ design are encouraged to ass 1 'in <nadn credit on 
successful unit test pprfnrmarve . 
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Table 1 

Correlation Coefficients Between Standat dized 
Retention Scores / Unit and Objectives Achieved 



Objectives Achieved Objectives Achieved 
all attempts first attempt 



Discipline Unit r .231 .268 

Retention Score .050 .027 

Performance Objectives r .175 .0fi4 

Unit Retention Score .152 .496 

Test Construction r .355 .303 

Unit Retention Score .003 .012 

Grading Practices r .307 .466 

Unit Retention Score .011 .0001 
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Total Objectives Achieved 



leyonci a-1 observation 
3 '2 obs jrvations 
C 3 ODSe^d ti ons 



Figure 1 

Bivdrant Distribution of Student Performance 
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